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SEARCHING THROUGH THE REALS 


SAM SANDERS 


Abstract. It is a commonplace to say that one can search through the nat¬ 
ural numbers, by which is meant the following: For a property, decidable 
in finite time and which is not false for all natural numbers, checking said 
property starting at zero, then for one, for two, and so on, one will eventu¬ 
ally find a natural number which satisfies the property, assuming no resource 
bounds. By contrast, it seems one cannot search through the real numbers in 
any similarly ‘basic’ fashion: The reals numbers are not countable, and their 
well-orders carry extreme logical strength compared to the basic notions in¬ 
volved in ‘searching through the natural numbers’. In this paper, we study 
two principles (PB) and (TB) from Nonstandard Analysis which essentially 
state that one can search through the reals. These principle are basic in that 
they involve only constructive objects of type zero and one, and the associated 
‘search through the reals’ amounts to nothing more than a bounded search 
involving nonstandard numbers as upper bound, but independent of the choice 
of this number. We show that (PB) and (TB) are equivalent to known systems 
from the foundational program Reverse Mathematics, namely respectively the 
existence of the hyperjump and Aj-comprehension. We also show that (PB) 
and (TB) exhibit remarkable similarity to, respectively, the Turing jump and 
recursive comprehension. In particular, we show that Nonstandard Analysis 
allows us to treat number quantifiers as ‘one-dimensional’ bounded searches, 
and set quantifiers as ‘two-dimensional’ bounded searches. 


1. Introduction 

1.1. Searching through the naturals and the reals. It is a commonplace to say 
that one can search through the natural numbers, by which is meant the following: 
For a property Q(n ), decidable in finite time and which is not false 
for all natural numbers, one successively checks if Q(0), Q(1),Q(2),... 
holds, and one will eventually find a natural number n such that 
Q(n ), assuming no further resource bounds. 

In fact, Kleene defines the class of partial recursive functions as those obtained 
via primitive recursion plus the axiom Unbounded search, and the latter exactly 
formalises the aforementioned informal description of ‘searching through the natural 
numbers’; We refer to [53} Def. 2.2, p. 10] for more details. Furthermore, the semi- 
constructive Markov’s principle has a similar interpretation (See [ 233 , 1.11.5]). 

In contrast to the case of the natural numbers, it seems one cannot search through 
the real numbers in any remotely ‘basic’ fashion: The reals numbers are not count¬ 
able, and the existence of a well-order requires the axiom of choice. Even fragments 
of the latter carry tremendous logical strength compared to the basic notions in¬ 
volved in ‘searching through the natural numbers’; See [221 Table 4] for a detailed 
overview of the strength of small fragments of the axiom of choice. 

In this paper, we show that the framework of stratified Nonstandard Analysis 
(See [5]) allows one to ‘search through the reals’ in a rather basic fashion. In 
particular, we formulate a nonstandard principle (PB) which essentially states that 

Department of Mathematics, Ghent University, Belgium & Munich Center for Math¬ 
ematical Philosophy, LMU Munich, Germany 
E-mail address: sasander<Sme.com. 



2 


SEARCHING THROUGH THE REALS 


one can search through the reals. The principle (PB) is basic in that it involves only 
constructing objects of type 0 and 1, and the ‘search through the reals’ amounts 
to nothing more than a bounded search through the natural numbers involving 
a nonstandard number as an upper bound. It should be noted that the bounded 
search is independent of the choice of the nonstandard number. We show that (PB) 
is equivalent to a known principle, namely the Suslin functional (See e.g. [51 1141 ). 
Similarly, we formulate an analogous principle (TB) and prove equivalence to A[- 
comprehension in functional form (See e.g. [221 1.11.8] for the latter). 

As to the structure of this paper, we provide some more detailed motivation in 
Section Q We introduce a suitable weak ‘base theory’ in Section [2] and recall 
known results. In Section fd.il we formulate the principle (PB) and prove its equiv¬ 
alence to the Suslin functional ( S 2 ) over our base theory. In Section 15751 we obtain 
similar results for A [-comprehension and the principle (TB). 

As to background information, (S' 2 ) is the functional version of the strongest ‘Big 
Five’ system n[-CAo studied in the foundational program Reverse Mathematics. 
The principle A]- comprehension is also studied in the latter program. We refer to 
BUH2I1I22] for more details. We do point out the following quote by Simpson: 
From the above it is clear that the five basic systems RCAo, WKLo, 

ACAo, ATRo, n[-CA 0 arise naturally from investigations of the 
Main Question. The proof that these systems are mathematically 
natural is provided by Reverse Mathematics. (i m p- 43 ]). 

Hence, the principle (PB) is mathematically natural due to its equivalence to ( S 2 ), 
the functional version of n]-CAo. Finally, we urge the reader to first consult Re¬ 
mark [5] so as to clear up a common misconception regarding Nelson’s approach to 
Nonstandard Analysis. 

1.2. Motivation. In this section, we discuss the background of, and more detailed 
motivation for, the topic of this paper. We first study the notion of ‘searching 
through the naturals’ in Nonstandard Analysis. We only require very basic famil¬ 
iarity with Nelson’s internal set theory, also introduced in Section [2] 

Firstly, we show that ‘searching through the naturals’ amounts to a bounded 
search in Nonstandard Analysis. To this end, recall that by Post’s theorem a 
computable set can be described by a A^-formula, and vice versa (El Theorem 2.2, 
p. 64]). Thus, consider the A°-formula, relative to ‘st’, given by: 

(y st n°)[(3 st k)f(n,k) = ()«->• ( V st m)g(n,m ) ^ 0]. (1) 

Now define p(n,h,M) as (pk < M)h(n,k) = 0, if such exists and M otherwise. 
Then it is easy to show that for any infinite number M°: 

(V st n°) [(3 st fc)/(n, k) = Oo p(n , /, M) < 0 p(n, g , M)\. (2) 

Hence, to decide if a Aj-formula (relative to ‘st’) holds, one need only perform a 
bounded search , where the upper bound is any nonstandard number. 

Secondly, we show that relative to the Turing jump ‘searching through the nat¬ 
urals’ also amounts to an explicit bounded search in Nonstandard Analysis, in 
contrast to the Turing jump’s ‘oracle status’. To this end, consider the Turing 
jump functional: 

(3y ,2 )(V/ 1 ) [(3x°)f(x) = 0 <->• <£>(/) = 0], (3 2 ) 

which by [5] Cor. 12] is equivalent over a version of EFA to 

(V st f 1 ) [(V st x°)f(x) ^ 0 (Wx)f(x) ? 0]. (n?-TRANS) 

^The exact meaning of ‘constructive’ will be clarified in Section 13.11 The interpretation we 
have in mind is ‘acceptable in Bishop’s Constructive Analysis'. See [7] for the latter. 
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The latter is the Transfer principle from Nonstandard Analysis limited to 115- 
formulas. As it turns out, II^-TRANS provides a straightforward way to turn 
rt^-formulas into bounded formulas: For standard / 1 possibly involving standard 
parameters and infinite M°, II^-TRANS implies that 

(V*°)(/(s) ^ 0) o (Vz° < 0 M)(f(x) ± 0) (3) 

Hence, to find a (standard) zero for standard / , one need only perform the bounded 
search (/j,k < M)f(k ) = 0. Furthermore, the latter (resp. the right-hand side of 
ED) is elementary computable (resp. decidable) in terms of / and M , and involves 
only objects of type zero besides /. This explicit nature, and the similarity to a 
n^-formula, should be contrasted to the right-hand side of (3 2 ). In other words, 
the right-hand side of ED is much less of a ‘black box’ than that of the ‘oracle’ (3 2 ). 

In short, the two previous examples suggest that ‘searching through the naturals’ 
amounts to nothing more than a bounded search (involving an arbitrary nonstan¬ 
dard number) in Nonstandard Analysis. This search is ‘basic’ in that it is given by 
an explicit formula, and is closely connected to the original formula. 

The aim of this paper is to show that a similarly basic ‘bounded search’ in 
Nonstandard Analysis allows us to ‘search through the real numbers’ using the al¬ 
gorithm (21) defined in Section[37TJ We follow Kohlenbach ([TTJ p. 289]) in assuming 
that any sequence of type one can be viewed as a real using his ‘hat function’. In¬ 
tuitively speaking, we shall establish that Nonstandard Analysis allows us to treat 
number quantifiers as ‘ one-dimensional ’ bounded searches (as in ED and ED), and 
set quantifiers as ‘two-dimensional’ bounded searches (as in ED and EDO- In par¬ 
ticular, we will formulate (PB) which constitutes a similar ‘bounding result’ as in 
ED generalised to n \-formulas. In the same way as n^-TRANS is essential to ED, 
the principle n]-TRANS is essential in establishing (PB): 

(V s */ 1 ) [(VV)(3 st z°)/(^) ^ 0 *+ (Wg^Bx^figx) ? 0] (n(-TRANS) 

What is more, by [5J Cor. 15] and Theorem [TT1 n}-TRANS is equivalent to (PB), 
and to the Suslin functional , defined as follows: 

(3S 2 )(Vf) [S(f) =o 0 o (3 g l ){Vx°){f{gx) = 0).] (S 2 ) 

The Suslin functional is the ‘hyperjump’ functional and corresponds to n]-CAo, the 
strongest so-called Big Five system from Reverse Mathematics (See VI]). 

Inspired by the results regarding the Suslin functional, we obtain a similar bound¬ 
ing result (TB) for A (-comprehension using Aj-TRANS, i.e. the Transfer principle 
limited to A]-formulas. In particular, we obtain a version of ED for A]-formulas 
to underline the analogy between standard sets and nonstandard numbers. 

As to methodology, inspired by the bounding result ED, we shall require that 
the bounded formula (equivalent to the n( or A]-formula at hand) in (PB), (TB), 
and related principles, is basic, by which we mean that it satisfies the following: 

(I) Only type 0 and constructive type 1 objects occur in the bounded formula. 

(II) The syntactic structure of the bounded formula is similar to that of the 
original nj or Aj-formula. 

With regard to condition (1TT1) . nj-formulas can be brought into the Kleene normal 
form (See [22: V.1.4]). The latter can be gleaned from the Suslin functional and 
we will directly work with this normal form. Furthermore, it is clear that the well- 
known practice of ‘coding sets of numbers as nonstandard numbers’ (See e.g. |T3]) 
is not basic in our sense, as we deal with equivalent bounded formulas. 
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Finally, to obtain the aforementioned results, we need to adopt the richer frame¬ 
work of stratified Nonstandard Analysis developed by Hrbacek (M) and pio¬ 
neered by Peraire (113). We briefly introduce this framework in Section [2] 

2. Nonstandard Analysis 

In this section, we define the system in which we shall prove the equivalences 
mentioned in the previous section We first introduce Nelson’s internal set theory 
and a suitable subsystem RCAq thereof in Section I2TT1 We then introduce stratified 
Nonstandard Analysis and RCAj, a suitable extension of RCAq , in Section [2.21 

2.1. Nelson’s syntactic Nonstandard Analysis. In Nelson’s internal set theory 
am), a syntactic approach to Nonstandard Analysis as opposed to Robinson’s 
semantic one (US ), a new predicate l st(a;)’, read as l x is standard’ is added to the 
language of ZFC. The notations (V st a;) and (3 st y) are short for (Vx)(st(a;) -A ...) 
and (3y)(st(y) A ... ). The three axioms Idealization , Standard Part, and Transfer 
govern the new predicate ‘st’ and give rise to a conservative extension of ZFC. 
Nelson’s approach has been studied in the context of higher-type arithmetic in e.g. 
I2U and we single out one particular system, called RCAq . 

In two words, the system RCAq is a conservative extension of Kohlenbach’s base 
theory RCAq from QT] with certain axioms from Nelson’s Internal Set Theory based 
on the approach from BH5|. This conservation result is proved in [5], while certain 
partial results are implicit in [?|. In turn, the system RCAq is a conservative 
extension of the base theory of Reverse Mathematics RCAq for the second-order 
language by m Prop. 3.1]. Following Nelson’s approach in arithmetic, we define 
RCAq as the system 

E-PRA“* + QF-AC 1 ’ 0 + HAC int + I + PF-TP V 

from [5] §3.2-3.3]. To guarantee that the latter is a conservative extension of RCAq , 
Nelson’s axiom Standard part must be limited to HAQ n t, while Nelson’s axiom 
Transfer has to be limited to universal formulas without parameters, as in PF-TPy. 
On a technical note, the language RCAq actually involves a predicate st p for every 
finite type p , but the subscript is always omitted. 

Theorem 1. The system RCAq is a conservative extension of RCAq. The system 
RCAq is a III]- conservative extension of PRA. 

Proof. See [S] Cor. 9]. □ 

The conservation result for E-PRA“ t * + QF-AC 1,0 is trivial. Furthermore, omitting 
PF-TPy, the theorem is implicit in [3] Cor. 7.6] as the proof of the latter goes through 
as long as EFA is available. 

The following theorem of RCAq is important. Note that the abbreviation l M G 
fl’ for -ist(M°) is used. The statement that d4j) — ^ (O f° r ah such standard func¬ 
tionals is abbreviated fl-CA. If for a standard functional F, the functional F(-, M) 
satisfies ©, we say the latter is f l-invariant. 

Theorem 2. In RCAq , we have for all standard F^ crx0 ^° that 

(V st x a )(VM, N eft) [F(x, M) = F(x, A)] (4) 

—> (3 st G a ^°){V st x a )(yN° G n) [G(ar) = 0 F(x, A)]. (5) 


Proof. See [2D] §2]. 
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The ‘base theory’ RCAg is quite useful in establishing equivalences, as is clear from 
the following theorem, which also establishes that the omission of parameters in 
PF-TPy is necessary (for obtaining a conservative extension as in Theorem [Tj). 

Theorem 3. The system RCAq proves II^-TRANS (3 2 ). Adding QF-AC 1 ' 1 , we 
obtain ( S 2 ) o II]-TRANS. 

Proof. By [5J Cor. 12 and 15]. □ 

Finally, the following theorem establishes that restricting the Standard Part 
principle as in HAQ nt is necessary (for obtaining a conservative extension as in 
Theorem [T]). Let WKL be weak Konig’s lemma as in [22; IV] and let (1STPh be 

(V* 1 )(3 Bt y 1 )(V Bt x 0 )(x e X +* x G Y). (STP) 

Note that F2-CA for a = 1 is a version of the Standard Part Principle (1STPI) . 

Theorem 4. In RCAq + (1STPI) . we have WKL. 

Proof. See [2D1 §5]- By way of a sketch, a standard binary tree with sequences of 
any standard length also contains a sequence of nonstandard length (by overspil or 
induction). Apply (ISTPI) to the latter sequence to obtain a standard path through 
the tree, and hence WKL sl . Rewrite WKL &t as its contraposition, sometimes called 
fan theorem, and apply QF-AC 1,0 relative to ‘st’ (which follows from HAQ n t) to 
the antecedent. Drop all ‘st’ in the antecedent and consequent of the innermost 
implication, and apply PF-TPy to yield WKL. □ 

By [TTirnT] . (ISTPI) actually yields a conservative extension of WKL 0 from [22 IV]. 

2.2. Stratified Nonstandard Analysis. The framework of Stratified Nonstan¬ 
dard Analysis flSHnmzi) is a refinement of Nelson’s where the unary standardness 
predicate ‘st(x)’ is replaced by the binary predicate ‘x C y\ read as ‘x is standard 
relative to y' and x E 0 is still read l x is standard’ or ‘st(rr)’. We denote ~<(y C a;) 
by x C y and say that L y is nonstandard relative to x’. 

In the same way, extend the language of RCAq with new predicates C PjT , one 
for each pair of finite types. We will often omit the subscript as is common for the 
standardness predicate of RCAq . The axioms of RCAq govern the predicate st(x), 
whereas the following basic axioms govern x Q y. 

Axiom 5 (BASIC). 

(i) (Vx)[st(x) hiCO]. 

(ii) (Vx)(0 CxAxCx). 

(iii) (Vx, y,z) [(x C y A y C z) — > x C z]. 

(iv) (Vx)(3?/ 0 , z°)(x C y A x C z). 

(v) (Vx a ^ T ,y a ,z)[x,y Q z x{y) C z). 

The BASIC axioms are rather elementary and express the following facts: 

(i) Being standard is the same as being standard relative to zero. 

(ii) All objects are standard relative to themselves. Zero is the ‘least’ level of 
standardness. 

(iii) Transitivity holds for ‘being standard relative to’. 

(iv) Every level of standardness is inhabited by a number. There always exists 
a similarly inhabited higher level. 

(v) Functional application preserves relative standardness. 

Denote RCAj as RCAq + BASIC in the language extended by ‘C’. Clearly RCAj is 
only a definitional extension of RCAq , i.e. the former is also a conservative extension 
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of RCAq and PRA similar to Theorem [T| We also require the following Standard 
part principle, not stronger than (1ST PI) . 

(VX 1 , z)(3Y 1 C z)(Vx° E z)(x GY^xGX). (STP2) 

We hnish this section with an important remark about the internal framework. 

Remark 6. Tennenbaum’s theorem (JT2, §11.3]) ‘literally’ states that any non¬ 
standard model of PA is not computable. What is meant is that for a nonstandard 
model M. of PA, the operations +m and Xm cannot be computably defined in 
terms of the operations +n and Xjg of the standard model N of PA. 

While Tennenbaum’s theorem is of interest to the semantic approach to Nonstan¬ 
dard Analysis involving nonstandard models, RCAq is based on Nelson’s syntactic 
framework, and therefore Tennenbaum’s theorem does not apply: Any attempt at 
defining the (external) function ‘+ limited to the standard numbers’ is an instance 
of illegal set formation, forbidden in Nelson’s internal framework (' [161 p. 1165]). 

To be absolutely clear, lest we be misunderstood, Nelson’s internal set theory 1ST 
forbids the formation of external sets {x £ A : st(x)} and functions ‘/(x) limited 
to standard x’. Therefore, any appeal to Tennenbaum’s theorem to claim the ‘non- 
computable’ nature of + and x from RCAq is blocked, for the simple reason that 
the functions ‘+ and x limited to the standard numbers’ simply do not exist. On 
a related note, we recall Nelson’s dictum from m p. 1166] as follows: 

Every specific object of conventional mathematics is a standard set. 

It remains unchanged in the new theory [1ST]. 

In other words, the operations ‘+’ and ‘x’, but equally so primitive recursion, 
in (subsystems of) 1ST, are exactly the same familiar operations we know from 
(subsystems of) ZFC. Since the latter is a first-order system, we however cannot 
exclude the presence of nonstandard objects, and internal set theory just makes 
this explicit, i.e. 1ST turns a supposed bug into a feature. 

3. Main results 

3.1. Stratified bounding and the Suslin functional. In this section, we formu¬ 
late the bounding principle (PB) and prove its equivalence to the Suslin functional. 
We also prove that (PB) gives rise to the algorithm (21) for finding witnesses to 
£}-fornrulas relative to the standard world. 

First of all, we prove some ‘relative’ versions of the Transfer principle. 

Theorem 7. In RCAj, II^-TRANS is equivalent to 

(V^XV/ 1 E z) [(Vx° E z)f{x) / 0 -A (Vx)/(x) ^ 0], 

and Il]-TRANS is equivalent to 

(V^XV/ 1 E z)[(Vg 1 E z)(3x°)f(gx) ± 0 (Vg 1 )(3x°)f{gx) ± 0] 

Proof. Clearly, the reverse implications follow from BASIC and taking z = 0. By 
0 Cor. 12], nJ-TRANS is equivalent to the following sentence: 

(3/XXV/ 1 ) [(3x°)/(x) = 0 /(a(/)) = 0]. (A 2 ) 

Since (a 2 ) does not involve parameters, we may apply (the contraposition of) PF- 
TPy to (a 2 ), and hence assume that a as in (a 2 ) is standard. Thus, we have a E z 
for any z by axiom (lull) in BASIC. By axiom (jvj) in the latter, for any / E z, we 
have a(/) E z. By the definition of (a 2 ), if (3x°)/(x) = 0, then (3x° E z)f(x) = 0, 
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which is what we needed to prove for II^-TRANS. One proceeds in exactly the same 
way for n]-TRANS, as the latter is equivalent to 

(du^XV/ 1 ) [(3 3 1 )(V.T°)(/(gx) = 0) ->• (yx°)(f(v(f)x) = 0)], ( 6 ) 

by 0 Cor. 15], and we are done. □ 

The functional (0) is called (/zi) in [3], and is equivalent to ( S 2 ) assuming QF-AC 1,1 . 
It is clear that (/zi) and ( S 2 ) do not satisfy either of the conditions dj) and (Hill . 

Secondly, we consider an important consequence of the idealization axiom I. 

Theorem 8 . In RCAq , there is a ( nonstandard ) function h J which dominates all 
standard f 1 everywhere, i.e. (V st / 1 )(Vn°)(/(?z) <o ho(n)) or (V st / 1 )(/ <i ho) ■ 

Proof. Note that the following formula is trivially true: 

(V st 3 1 *)( 3 /i 1 )(Vfc 1 e g)[(Vx°)(k(x) < 0 h(x))], (7) 

where T*’ is the type of sequences (with length of type 0) of type 1 objects. The 
formula in square brackets in 0 is internal and applying idealization I yields: 

(3/i 1 )(V st g 1 )[(Va; 0 )(g(a;) < 0 h(x))]. 

The function h is as required for the theorem. □ 

Remark 9 (Constructive idealization). We shall refer to the function ho from 
Theorem [ 8 ] as ‘constructive’ for the following reason: The proof of Theorem [S] 
trivially goes though in the system H from [3] §5.2], which is a conservative extension 
of Heyting arithmetic with among other axioms I (See 0 Cor. 5.6]). Hence, the 
existence of ho is constructively acceptable, in that the axiom 1 included in the 
system H results in a conservative extension of Heyting arithmetic (in the original 
language). Heyting arithmetic in all finite types is only a small fragment of the 
usuaQ systems providing a foundation for Bishop’s Constructive Analysis ({?]). 
Hence, we may refer to the function ho as ‘constructive (in the sense of Bishop)’. 

Thirdly, we formulate our long-awaited bounding principle (PB). The function 
ho therein is intended to be the one from the previous theorem. Recall also the 
definition of ‘r° <o* cx 0 ’ as |oj = |r| A (Vz < |oj)(r(z) <o cx(z)). 

Principle 10 (PB). There is ho □ 0 such that for f 1 C0,h>\ho and M □ h, 

(VV)(3 st x°)(/(5aO ^ 0) (V 5 ° < 0 * hM)(3x° < M)(f(gx) ? 0). (8) 

Fourth, we prove the following theorem. By m Theorem 2.2] and [T3], the base 
theory is weak, i.e. certainly not stronger than ACAo and WKLo respectively. 

Theorem 11. In RCAj + (ISTP2I) . we have (/zi) -O- (PB) -o- n]-TRANS. 

In RCAj + (glEZD + QF-AC 1 ’ 1 , we have ( S 2 ) o (PB) o nJ-TRANS. 

Proof. We establish n]-TRANS O (PB) in RCAj + (ISTP2I) using Theorem [7] and 
the theorem is then immediate by 0 Cor. 15]. 

In order to prove nj-TRANS —>• (PB), consider ho from Theorem 0 assume 
(y st g 1 )(3 st x°)(f(gx) ^ 0) for /CO and apply n]-TRANS to obtain (V 5 1 C 
ho){3x° C h 0 )(f(gx) ^ 0). Now consider g 0 <1 ho (which may or may not satisfy 
go E h 0 ) and apply (ISTP2I) to obtain g 1 C ho such that: 

(Vx° C h 0 )(g 0 (x) = gi(x)). 


2 We have in mind such systems as CZF and Martin-Lof Type Theory (HKD)- 


( 9 ) 
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Since we already proved (Vg 1 E /io)(3:r 0 E ho)(f(gx ) ^ 0 ), we obtain (3aio E 
ho){f(g!xo) / 0). By ©, we also get (3a ; 0 E ho)(f(gox 0 ) / 0), as g^z = 0 glz E h 0 
for any z E ho- Hence, we have proved that 

(V 5 1 <1 h 0 )(3x° E h 0 ){f(gx 0 ) ^ 0 ), 
and for h 0 C M°, we obtain: 

(V 5 1 <1 h 0 )(3x° < M)(f(gx 0 ) ± 0 ). ( 10 ) 

By definition, m now yields: 

(V ff ° < 0 . Mf)( 3x° < M)(f(gx 0 ) ^ 0). (11) 

Indeed, for g° < 0 * hoM, define l 1 := g * 00 ... and apply in light of l <1 ho. 
Now repeat the above steps for any h >1 ho instead of ho to obtain the forward 
implication in (151) . 

Now assume the formula m for M □ ho and ho as in the first paragraph of 
this proof, and consider standard g 1 . By the definition of ho, we have g <1 ho, 
implying ~gM < 0 * hoM. By assumption, we have (3a ; 0 < M)(f(gMx 0 ) ^ 0), 
which immediately yields (3a ; 0 < M)(f(gxo) ^ 0 ) and also (3a ; 0 E M)(f(gx 0 ) ^ 
0). Applying n°-TRANS yields (3a : 0 E 0)(f(gxo) 7 ^ 0), and we have proved 
(V Bt g 1 )(3 Bt x 0 )(f(gx) / 0). The equivalence © now follows. 

For the implication (PB) —> n}-TRANS, note that (PB) implies n^-TRANS, 
which immediately yields the reverse direction in n^-TRANS. To prove the remain¬ 
ing implication in the latter, assume (V st g 1 )(3 st x°)(f(Tjx) ^ 0) for standard /, and 
let ho be the function from (PB). Fix g\ and define h 1 by h(n) := max(fto(n), <?i(n)). 
Clearly, h >1 h 0 , yielding (\/g° < 0 * hM)(3x° < M)(f(gx) ^ 0) by (PB) for 
M □ h. Hence, for 5 0 = ~giM, we obtain (3a ; 0 < M)(f(]jox) ^ 0), implying 
( 3 a; 0 )(/( 5 Ta;) 0). Then (V^ 1 )(3a ; 0 E g)(f(gx) ^ 0) by n°-TRANS and the for¬ 
ward implication in njyTRANS also holds. □ 

Comparing © and ©, we note that Nonstandard Analysis allows us to treat 
type zero quantifiers as ‘one-dimensional’ bounded searches, and type one quantifiers 
as ‘two-dimensional’ bounded searches. 

It is then a natural question, originally due to Dag Normann, if © allows one 
to find a standard g 1 such that ( V st x 0 )(ffgx ) = 0), assuming such exists? Now, 
the formula © from (PB) suggests the following algorithm to solve this question. 
As above, we fix ho as in Theorem [ 8 ] and M I] ho- 

Algorithm 12 (21). Check in lexicographical order starting with a = 00 ... 00 the 
formula A(cr) = (\/x° < M)(f(ax) = 0) for all a of length M and bounded above 
by hoM . Output the lexicographically first ao satisfying A(ao) if such there is, and 
Mq ... Mo otherwise, where Mo = ma x^<m ho{i). 

Let us denote by 2l(/) the output of the previous algorithm on input f 1 . Note 
that there is no a priori reason why 2 l(/) even outputs a sequence with a standard 
part, i.e. such that (V st n°)st(2l(/)(n)), as the lexicographical order places lotf 0 of 
sequences without a standard part before those with one. 

The previous observation notwithstanding, the following corollary shows that 
for standard f 1 and assuming (PB), the algorithm (21) always outputs a witness to 
(3 st g 1 )(W st x°)(f(gx) = 0) if and only if the latter formula holds. In other words, 
( 21 ) finds the required standard witness if such exists. 

'Tor instance, the sequence 0M00 .. . 00 comes before nOO ... 00 for any infinite M° and stan¬ 
dard n° in the lexicographical order. In general, there does not seem to be an internal ordering 
in which all the type zero sequences with standard part come first. 
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Corollary 13. In RCAj + (ISTP2I) + (PB), we have 

(V 8 */ 1 ) [(V st n°)st(2l(/)(n)) ^ (3 st g 1 )(V st x°)f(gx) = 0 ]. ( 12 ) 

Proof. The forward direction in OSD is immediate due to (1ST PI) . For the reverse 
direction, by the theorem, we may use nj-TRANS; Now suppose that for some 
standard /o, we have the right-hand side of 01 and the sequence 2 l(/o) is such that 
(3 st no) _, st(2l(/o)(no+l)). For now, we assume that no is the least such number, and 
later prove that such a least number indeed exists using dsm By our assumption, 
the sequence 2 t(/o)no is standard and we have the following formula: 

(3ct? <o* h 0 M) [(Vx° < M)f 0 (o\x) = 0 A oTn 0 < 0 * 2t(/o)n 0 ] ■ (13) 

Since (Vn° E ho)(a(n) < ho{n)), we can apply (ISTP2I) for z = ho and obtain g E ho 
which is the standard part of <ri in the previous formula. Hence, 01 yields: 

(Bg 1 E h 0 ) [(Vx° E h 0 )f 0 {gx) = 0 A gn 0 < 0 * 2l(/ 0 )n 0 ]. (14) 

By (a trivial variation of) Theorem [T) the previous formula and n)-TRAI\IS yield: 

(3 st 3i) [(Vx°)/o(gTx) = 0 A gln 0 < 0 * 2l(/ 0 )n 0 ]. (15) 

Note that we are allowed to apply Transfer as 2l(/o)no is a standard parameter in 
(iFll) by the axioms T* t of RCAq (See [U Def. 2.2 and Lemma 2.8]). Alternatively, 
use (ELE1 to obtain the standard part of 2 l(/o)no * 00 ... and replace the latter by 
the former in (1141) . 

However, for the standard g\ as in (fl5l) . we also have 51 (no + 1) < 2l(/o)(rio + 1), 
as the former number is finite, and the latter infinite. Hence, it is clear that ~g\M 
comes before 2 l(/o) in the lexicographical ordering, and ( 21 ) should have output 
9 \M by (USD- This contradiction proves the theorem, modulo our assumption on 
no- To prove the latter assumption, we will prove the following version of external 
induction using (ISTPD : 

(V/ 1 ) [[st(/(0)) A (V st m)(st(/(m)) -> st(/(m + 1)))] -» (V st n)st(/(n))]. (16) 

To this end, fix f 1 satisfying the antecedent of (USD and define the set X 1 as 
{{n,f(n)) : n = n} (using the well-known (standard) coding of pairs). Using 
(ISTPD . let Y 1 be the standard part of X, and let Z be the projection of Y onto the 
first coordinate. Then 0 G Y and (V st m 0 )[m & Y ^ m + 1 & Y]by the antecedent 
of (fTBD . By (quantifier-free) induction, we have (V st n°)(n € Y), implying the 
consequent of m • Finally, note that our assumption on no from the previous 
paragraph of this proof, follows from the contraposition of disD . □ 

In light of the above, it is straightforward to formulate a version of m equivalent 
to (PB) using h>\ ho and M □ h as in the latter. 

In conclusion, we have proved that (PB) gives rise to the algorithm (21) for finding 
witnesses to Ej-formulas relative to the standard world. In particular, Corollary [T bI 
establishes that (PB) expresses that one can search through the reals. We end this 
section with a highly relavant note on generalisations of (PB). 

Remark 14 (Generalisations). Above, we proved (PB) for standard functions / , 
but the proof of Theorem |TT] easily generalises to any / using the following ‘rela¬ 
tivised idealisation’: 

(Vz) [(VaU* C z)(3y T )(\/x' G x)<p(x', y) -> (3y r )(Vx <T E z)ip(x, y)] . (rl) 

Indeed, in the same way as in the proof of Theorem [Sj the axiom (rl) easily yields 
a function h 1 □ z which dominates all functions f 1 E z everywhere, i.e. (V / 1 E 
z)(Vn°)(/(n) <0 h(n)). It is then easy to obtain a version of (PB) for ‘E 0’ replaced 
by ‘E z’ following the proof of Theorem [III This version would be as follows: 
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Principle 15 (rPB). For all z, there is ho □ * such that for f 1 E z, M □ h >i /io : 

(V5 1 E z)(=te° C *)(/(3*) / 0) aa (V 5 ° < 0 . WH)(3x 0 < M)(f(gx) ± 0). (17) 

A generalised version of the algorithm (21) can now be read off from (rPB). 
Finally, in the same was as for [4) Cor. 7.8], one proves that (rl) yields a conservative 
extension of Peano Arithmetic (and the same for fragments at least EFA). These 
generalisations are straightforward and we therefore do not go into details. 

3.2. Stratified bounding and A]-CAo. In this section, we establish a bounding 
result like (PB) for the system A]-CAo (See [221 1.11.8]). In light of the similarities 
between the nonstandard treatment of II)* and A°-formulas in Section Q such 
a result is expected. We use the abbreviation D(f,g) for the following formula, 
expressing that f,g give rise to a A] -formula: 

(3h 1 )(\/x°)[f (hx) = 0] AA (Vfe 1 )(32/°)[fl-(fey) ± 0], 

First of all, consider the following comprehension and transfer principle: 

(V/ 1 , 9 1 ) [D(f , g) -A [D(f, g) AA (3 st ft 1 )(V s *a: 0 )(/ (hx) = 0)]], (A]-TRANS) 
(3 $(ixi)-^i )(yf\ g i)[D(f ig ) -a [$(/, fl ) = 0 aa (3h 1 )(Vx°)(f(hx) = 0)]]. (D 2 ) 

Clearly, (D 2 ) is the functional version of A)-CA, and we have the following theorem. 
Theorem 16. In RCAq + (1STPI) + QF-AC 1,1 , we have A]-TRANS AA (D 2 ). 

Proof. Clearly, both principles imply II^-TRANS and (3 2 ). Assume (D- 2 ) and drop 
the reverse implication in the consequent. In the resulting formula, bring all type 
one-quantifiers to the front, which results in a formula of the form (3<f>)i/>(<l>) where 
ijj € n^. The existential set-quantifiers in originate from the (dh 1 ) in the 

consequent of (D 2 ), and the reverse implication in D(f, g ). The universal quantifiers 
in ip(^) originate from (V/ 1 ,^ 1 ) and from the forward implication in D(f,g). Now 
use (3 2 ) to remove arithmetical quantifiers in ip(t f>) and apply QF-AC 1,1 to obtain H 
witnessing the existential set-quantifiers in if($>). One of the components of H, say 
the first one, witnesses the existential quantifier which originated from the (3/r 1 ) 
quantifier in the consequent of (D 2 ); We ignore the other components of 5, and 
obtain the following, thanks to the definition of £)(/, <7): 

(3*, 3 XV/V) [£(/,</) -A [$(/,<?) = 0 —t (Vx°)(f(Z(l)(f,gJ,g)x) = 0)]]. (18) 

Since the previous formula is parameter-free, we may assume $ and S are standard 
by PF-TP V . Hence, if D(f, g) for standard f 1 , g 1 , S(/, g , /, g) is a standard witness 
for the left-hand side of D(f,g ), if this side holds, and A]-TRANS follows. 

Now assume A)-TRANS and note that the latter and n^-TRANS imply: 

(V st / 1 ,5 1 )(3 st / 1 )[D(/, ff ) -a [(3A 1 )(V.t 0 )(/(At) = 0) -A (3k 1 < x l l )(Vx°)(f(hx) = 0)]] 

Apply HACi n t to obtain standard v[/( lxl ) _>1 * such that (31 £ T(/, g)). Define 
<£>(!x 1)—s-i ag f 0 ii ows: <&(f,g)(n) := max i< ^^ tg ^ i Sf(f,g)(i)(n). Clearly, we have 
for all standard f 1 ^ 1 that if D(f,g) then 

(3h 1 )(Vx°)[f(hx) = 0] (3k 1 <1 $(/, g))(\/x°)(f(hx) = 0)], (19) 

and the reverse implication is trivial. By (1STPI) and (3 2 ), the consequent of (HUll 
is equivalent to (3 h° <0* *!>(/, g) M)(Va; 0 < M)(f(hx) = 0)] for any infinite M. 
Hence, with the same assumptions in place, we obtain: 

(3 st h 1 )(V it x 0 )[f(hx) = 0] aa (3 h° < 0 . Wt)M)(Vx° < M)(f(hx) = 0)]. 

Using fl-CA, we obtain the functional as in (£>2) st . The latter implies (D 2 ) in the 
same way that ( S 2 ) AA (5' 2 ) st in the proof of 0 Cor. 15]. □ 
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We now prove a result similar to Theorem [7] for A]-TRANS. 

Corollary 17. In RCAj, Aj-TRANS is equivalent to its relativised version: 

(yz)(Vf 1 ,g 1 E z)[D(f,g) -A [D(f,g) <a (3k 1 C z)(fJx° C z)(f(hx ) = 0)]]. 

Proof. Immediate from (HU). □ 

Now define the following versions of (PB) as follows: 

Principle 18 (SB). There is ho □ 0 such that for f 1 , g 1 C 0 with D(f, g), l 1 >i ho, 
and M° □ l, we have 

(V st k 1 )(3 st x°)(f(kx) ± 0) o (Vfc° < 0 * lM)(3x° < M)(f(kx) ± 0). (20) 

Let P(k 1 ,h 1 ,M°) be the lexicographically least sequence cr° <o* hM of length 
M such that (Vx° < M)(k(ax) = 0), if such exists and M 0 ...M 0 (of length M ) 
otherwise, where Mq is the maximum of h(i) +1 for i < M. The following principle 
should be compared to © in Section fi~2l 

Principle 19 (TB). There is ho □ 0 such that for all f x ,g l C 0 with D{f,g), all 
l 1 >i ho, and all M° □ l, we have 

(d^XV^X/tfcr) = 0) o P(f,l,M) <„. P(g, l, M). (21) 

Theorem 20. In RCAt A flSTPi^ll +QF-AC 1 ’ 1 . (D 2 ) <A (SB) ca (TB) ca A]-TRANS. 

Proof. The proof of Theorem [TT] can easily be adapted to yield the equivalence 
to (SB). For the implication Aj-TRANS — > (TB), if the left-hand side of D(f,g) 
holds, there is a standard such h 1 and P(f, l, M) will be the initial segment of such a 
standard function. Since the right-hand side of D(f, g) holds, we can prove (Vfc° <o* 
lM)(3y° < M){g{ky) ^ 0) (using II^-TRANS and (1ST P2I) ~) in the same way as in 
the proof of Theorem [11] Thus, P(g, l, M) is MqMq ... MqMq by definition, and 
P(f,l,M) <o* P(g,l,M) follows. The reverse implication in (TB) follows similarly 
from A]-TRANS. The implication (TB) -A- A]-TRANS follows in the same way 
as for (SB), i.e. as in the proof of Theorem [TT1 by noting that P(f,l,M) in the 
right-hand side of m must be a sequence other than M 0 ■ ■ ■ M 0 , implying that 
(3k° < 0 * lM)(Vx° < M)(f(kx) = 0). □ 

Comparing m and we note that stratified Nonstandard Analysis allows 
us to treat type zero quantifiers as ‘one-dimensional’ bounded searches , and type 
one quantifiers as ‘two-dimensional’ bounded searches. Furthermore, as discussed 
in Remark m the search can be adapted to allow any parameter. Note that the 
right-hand side of m now plays the role of the algorithm (21) from Section 13.11 

3.3. Conclusion. We now formulate the conclusion of this paper. In particular, 
we exhibit the similarity between the notions ‘computable’ (in the form A°) and 
‘A}’, and ‘Turing jump’ and ‘hyperjump’. 

First of all, in light of Theorem fill the principle (PB) implies that for standard 
f 1 , ho as in Theorem [8] and M° □ /i 0 , we have 

(3^XV^H/Csz) = 0) o (3 ff ° <„. hoM)(Wx° < M)(f(gx) = 0). (22) 

Hence, if we know that ( 3g 1 )(yx°)(f(gx ) = 0), then (E^l) tells us that a ‘two- 
dimensional’ bounded search (involving the bounds hoM and M □ ho) will yield a 
sequence cr° of length M such that (V st a :°)(f(ax) = 0). By Corollary H3l we can 
find such a sequence with a standard part using the algorithm (21). By (ISTPI) and 
n°-TRANS, the output of (21) then has a unique standard part g 1 , which is such 
that (Vx°)(f(gx) = 0). The search performed by the algorithm (21) is similar to 
that associated to ©, i.e. the Turing (resp. hyper-) jump corresponds to a one- 
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(resp two-) dimensional bounded search. In both cases, an instance of the Transfer 
principle derives from the Turing- and hyperjump, and this principle is needed to 
certify that the associated search provides the correct output. 

Secondly, by Theorem[2ni a similar result is available for Aj-formulas, analogous 
to the case of A^-formulas. Indeed, to verify if a A^-formula as in (© (with ‘st’ 
removed) holds for some no, one checks, one by one, the following sequence: 

/(n 0 ,0) = 0, g(n 0 , 0) ^ 0, /(n 0 ,1) = 0, g(n 0 , 1)^0,..., (23) 

which by definition yields a terminating search, and gives rise to p(-,M) in (121). 
The latter is similar to P(-,l,M) from (12T1) . and one can perform a search simi¬ 
lar to (ED for a Aj-formula as in D(f,g) by checking (Vx < M)f(px) = 0 and 
( 3y < M)g(px) = 0 for p° equal to 00 ... 00, 00 ... 01, 00 ... 02, et cetera, where all 
sequences have length M (and are below hoM from Theorem [HJ). Thus, verifying if 
a A° (resp. Aj) formula holds, corresponds to a double one- (resp two-) dimensional 
bounded search involving p(-, M) (resp. P(-,ho, M)). 

Thirdly, we should stress that the right-hand sides of ©, d2Ul) , (1211) , and E21) do 
satisfy our conditions (HD and ((©. Indeed, as pointed out above, the function h 0 
from Theorem[5]is constructively acceptable, and there is a clear similarity between 
the Kleene normal form and the bounded formulas. 

In conclusion, stratified Nonstandard Analysis allows us to treat type zero quanti¬ 
fiers as ‘one dimensional’ bounded searches , and type one quantifiers as ‘two dimen¬ 
sional’ bounded searches. In particular, in light of Nelson’s dictum from Remark [G] 
that every specific object of conventional mathematics is a standard set, it seems 
that (PB), (SB), and (TB) allow us to search through the reals for internal prop¬ 
erties involving parameters from conventional mathematics , which is quite a rich 
world. By Remark 1141 the search can be adapted to allow any parameter. 
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